TEXAS  UNIV  AT  AUSTIN  CENTER  FOR  CYBERNETIC  STUDIES  F/G  12/1 

AN  ALGORITHM  FOR  A  LEAST  ABSOLUTE  VALUE  REGRESSION  PROBLEM  WITH— ETC (U) 
JUN  00  R  ARMSTRONG#  M  KUNG  N00014-75-C-Q569 

CCS— 378  _  _  NL 


■ 

1 

■ 

■ 

■ 

■ 

1 

■ 

■ 

■ 

END 

Sen 

DA091216 


j*»  ■ 


^OM 


CENTER  FOR 
CYBERNETIC 
STUDIES 

T  he  U niversit y  of  I exas 
Austin  .Texas  7S7 1 L' 


80  10 


O  •> 
O  i. 


Research  Report  378 


AN  ALGORITHM  FOR  A  LEAST  ABSOLUTE  VALUE 
REGRESSION  PROBLEM  WITH  BOUNDS 
ON  THE  PARAMETERS 

by 

R.  Armstrong 
M.  Kung* 


i  ' 


June  1980 


r  r  r. 

! i v  v 


*York  University,  Downsview,  Ontario,  Canada 


This  research  was  partly  supported  by  ONR  Contracts  N00014-75-C-0569 
and  N00014-80-C-0242  with  the  Center  for  Cybernetic  Studies,  The 
University  of  Texas  at  Austin.  Reproduction  in  whole  or  in  part  is 
permitted  for  any  purpose  of  the  United  States  Government. 


CENTER  FOR  CYBERNETIC  STUDIES 


A.  Charnes,  Director 
Business-Economics  Building,  203E 
The  University  of  Texas  at  Austin 
Austin,  Texas  78712 
(512)  471-1821 


Regression  Problem  with  Bounds  on  the  Parameters 


t  :i 

f 

!  .! 

ABSTRACT  3 


This  paper  presents  a  special  purpose  linear  programming  algorithm 
to  solve  a  least  absolute  value  regression  problem  with  upper  and  lower 
bounds  on  the  parameters.  The  algorithm  exploits  the  problem's  special 
i  structure  by  maintaining  a  compact  representation  of  the  basis  inverse 

I 

;  and  by  allowing  for  the  capability  to  combine  several  simplex  iterations 

into  one.  Computational  results  with  a  computer  code  implementation  of 


1 .  Introduction 

Least  absolute  value  (LAV)  regression  has  become  popular  recently  as 
a  robust  estimation  technique  [11]  .  This  has  come  about  as  a  result  of 
an  increasing  awareness  of  the  limitations  of  least  squares  analysis 
and  the  development  of  efficient  algorithms  for  obtaining  LAV  estimates  [2,5]  . 

This  paper  considers  a  restricted  least  absolute  value  regression 
problem  of  the  following  form. 

n  m 

(1)  Minimize  ,5,  |  y,  -  jj,  *ijBj  I  . 

subject  to  L .  <  B-  <  U.  ,  j  =  1,  2,  ...  ,  m. 

J  J  J 

For  purposes  of  exposition,  it  is  assumed  that  all  B-'s  have  upper  and 

J 

lower  bounds.  An  absence  of  an  upper  (lower)  bound  on  a  parameter  can 
be  handled  within  the  algorithm  to  be  developed  here  by  either  assigning 
an  arbitrarily  large  positive  (negative)  value  for  the  bound,  or  by  assuming 
the  existence  of  this  pseudo-bound  and  handling  it  logically  (i.e.,  no 
value  is  actually  assigned).  The  former  method  is  used  in  our  computer 
code  implementation. 

Special  purpose  algorithms  for  the  least  squares  (LSQ)  equivalent  of 
(1)  are  given  by  Armstrong  and  Frome  [1]  and  Waterman  [18].  These  algorithms 
were  able  to  deviate  from  the  standard  linear  programming  (LP)  approach  to 
solving  restricted  LSQ  problems,  commonly  called  quadratic  programming 
problems,  by  utilizing  the  special  structure  of  the  constraints.  Because 
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the  objective  function  of  (1)  is  convex,  a  modification  of  the  algorithms 
found  in  [l]  and  [18]  can  also  be  used  to  solve  the  restricted  LAV  problem. 
The  major  change  is  that  an  unrestricted  LAV  problem  must  be  solved  at  any  stage 
rather  than  an  unrestricted  LSQ  problem.  However,  inasmuch  as  the  most  efficient 
solution  method  for  the  unrestricted  LAV  problem  utilizes  LP  and  the  constraints 
of  (1)  can  be  handled  within  the  LP  framework,  it  would  seem  appropriate  to 
specialize  the  existing  LAV-LP  algorithms  to  solve  (1).  This  is  done  in  the 
next  section. 

2.  Algorithm 

Charnes,  Cooper  and  Ferguson  [8]  appear  to  be  the  first  to  have 
demonstrated  that  linear  LAV  problems  can  be  rewritten  as  LP  problems. 

Employing  their  result  here,  problem  (1)  is  equivalent  to: 

n  + 

(2)  Minimize  E  (6.  +6.  ), 

i=l  1  1 

subject  to  m  + 

E  x.  .8.  +  6.  -  6~.  =  y.  ,  i  =  1,  2,  ...  ,  n 

j=l  J  1  1  1 

L  j  £  8j  1  uj  ,  j  =  1 ,  2 ,  . . .  ,  m 

fit  >  0  and  6^0,  1  =  1,2,  ...  ,n. 

Davies  [10],  Barrodale  and  Roberts  [5]  ,  and  Spyropoulos,  Kiountouzis 
and  Young  [17]  give  closely  related  special  purpose  primal  simplex  algorithms 
to  solve  (2)  when  bounds  on  the  parameters  are  not  present.  These  algorithms 


f 
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currently  appear  to  be  the  most  efficient  method  to  solve  the  unrestricted 
LAV  problem.  Armstrong  and  Hultz  [3]  and  Barrodale  and  Roberts  [6]  develop 
primal  LP  algorithms  for  a  LAV  problem  with  arbitrary  linear  constraints 
on  the  parameters.  Both  algorithms  can  be  applied  to  problem  (2).  Armstrong 
and  Hultz  [3]  solve  the  restricted  LAV  problem  using  techniques  from  interval 
linear  programmi ng  [9]  while  Barrodale  and  Roberts  [6]  utilize  a  modification 
of  their  unconstrained  algorithm  which  was  presented  in  [4].  The  algorithm 
proposed  here  is  a  specialization  of  the  method  from  [3D.  It  will  be  demon¬ 
strated  that  considerable  computational  simplications  are  possible  when  the 
constraints  are  of  the  important  special  form  present  in  (2). 

To  aid  in  the  discussion  to  follow,  the  constraints  of  (2)  are 
rewritten  in  matrix  notation  as: 


Xp  +  16  -  I6_  *  Y, 

L  <  Ip  <  U, 

6+  >  0  and  6"  >  0. 


The  dual  problem  of  (2)  is: 


Maximize  z  ^.y.  +  z  w.U.  +  z  v.L. 

i=l  11  J-l  3  3  j=l  3  3 


subject  to 


i1.!  Vij  ♦  V  Vj  "  0.  ■  I.  2, 


•  • )  m 


<  1,  i  *  1,  2,  ...,  n 

tt j  ^  — 1,1  —  1,  2,  ...,  n 

Wj  <  0,  j  ■  1,  2,  ....  m 

Vj  >  0.  j  ■  1.  2,  ....  m 

The  dual  problem  (6)  will  be  used  later  with  the  explanation  of  the  algorithm. 
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Froni  the  results  presented  by  Armstrong  and  Hultz  [3]  ,  all  the 
information  required  to  execute  a  primal  LP  algorithm  can  efficiently  be 
obtained  from  a  list  of  indicators  and  the  inverse  of  an  m  by  m  basic  matrix. 
This  matrix,  Xg,  can  be  represented(af ter  rowand  column  interchanges),  relative 
to  problem  (2),  as  follows. 


where  is  an  r  by  r  full  rank  matrix,  XR  is  an  r  by  m-r  matrix,  0  is  an 

m-r  by  r  zero  matrix  and  I  is  an  m-r  by  m-r  identity  matrix.  This  structure 
assumes  that  r  rows  of  X  and  m-r  rows  corresponding  to  the  bound  constraints 
are  in  the  basis.  The  following  discussion  will  assume  that  the  rows  and 
columns  of  the  problem  have  been  explicitly  reordered  to  obtain  this  structure. 
The  computer  code  utilizes  two  arrays  to  implicitly  achieve  this  reordering. 

It  will  be  demonstrated  thatallthe  computations  required  in  the 
algorithm  can  conveniently  be  performed  by  inverting  only  Xp  which  shall  be 
referred  to  as  the  working  basis.  The  inverse  of  Xg  is  given  by: 
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The  solution  of  (1),  1,  can  be  partitioned  into  0 


■ft) 


where  Up  is  the  current  value  of  8^,  j*l,2,...,r,  and  UR  is  the  current  value  of 

3. ,  j=r+l,r+2,...,m.  From  equations  (3)  and  (4),  v  V-1  /Y B\ 

0  B  '  XB  {c  ) 

where  Yg  are  the  values  of  the  dependent  variable  corresponding  to  the  r  rows 
of  X  in  the  basis. and  C  assumes  the  value  of  either  U  or  L  depending  on  whether 
0.,  j=r+l,r+2,...,m  is  at  its  upper  or  lower  bound. 

J 


(':)■(;'  (:•) 


(XF7  "xf1xr^®^ 
XF  (YB  _  W 


By  a  list  of  bound  indicators,  the  elements  of  "$R  will  be  assigned  to  their 
upper (  or  lower  )  bound  value. 

Define  IB  to  be  the  index  set  of  the  rows  of  X  in  the  basis, 
and  NB  to  be  the  index  set  of  nonbasic  rows  of  X.  The  basic  and  nonbasic 
rows  of  I  will  be  determined  implicitly  within  the  computer  code  by  the  value 
of  r  and  the  current  column  ordering.  The  discussion  here  assumes  explicit 
reordering  at  each  iteration. 
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The  deviations  for  (2),  or  the  reduced  costs  for  the  dual 
problem  (6),  are  given  by: 

(8)  d.  =  y^  -  X.B  ,  i  =  1,2 . n. 

The  dual  variables  corresponding  to  the  nonbaslc  rows  are  assigned  a  value 
depending  on  the  sign  of  the  deviation,  that  is,  ir^  =  sign  (d^),  ie  NB. 
Degeneracy  occurs  when  d.  =0,  1  e  NB.  In  the  computer  code,  the  initial  value 
assigned  to  when  d..  =  0,  i  e  NB,  is  arbitrarily  defined  to  be  +1,  and 
thereafter,  the  value  is  determined  by  the  staps  of  the  algorithm.  A  thorough 
treatment  of  the  problem  of  degeneracy  can  be  found  elsewhere  (see  Chames  [7] 
for  example)  and  this  phenomenon!  will  not  be  examined  here. 

Define  the  nonbasic  dual  variables  w.  and  v.  to  be  zero.  Define 

J  J 

tb  to  be  the  vector  of  the  basic  dual  variables.  tg  can  be  partitioned  into 

Tn  and  xD  5  that  is, 
r  BR 

tB  =  (  tBf  ’  tBr  ) 


where 


Td  ~  (  Td  Tp  Tp  Tp  Tp  Tp  \ 

B  °i i  Br,  Br+1,  Br+2 .  Bm  ) 

tBf=  (  TBnTB2,...,  xBr  ) 

V  <  V.'  Tw-  \  > . 

The  vector  consists  of  the  basic  dual  variables  corresponding  to  the 
bF 

of  X  in  the  basis  (Xg),  and  Tg  consists  of  the  basic  dual  variables  corresponding 

R 

to  the  basic  bound  constraints.  The  nonbaslc  dual  variables  i^,  i  e  NB,  are  set  to 


r  rows 
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+1  or  -1.  The  nonbasic  w.  and  v.  are  zero.  Thus,  from  (6),  the  current  values 

J  J 

of  the  basic  dual  variables  can  be  obtained  from  the  dual  constraints, 
r  _ 

EVv  +  .£  tt-tX.*  •  *  0»  j-1,  2,  ....  r 

1-1  B*ij  ieNB  1  1J 


1  tr  xi  -i  +  tr  +  £ 

.•-1  Dj  1J  O-  j  _  UD  1  1J 


i=l  1 


Vb  ■  'hb 


"j  i  e  NB 


where  Hn  =  z  n.x. .,  j  =  1,  2,  ....  m 
Bj  ieNB  1  1J 


XB  =  ‘HBXB 


(9)  tb 


■"bV'f1 


j=  r+1 ,  r+2,  ...  ,  p.i 


(10)  T3r  =  "TBFXR  ‘  HBr 


Since  this  Is  a  primal  algorithm,  the  necessary  condition  for 
optimality  is  dual  feasibility.  The  optimality  condition  for  (2)  is: 


(11) 

-1  1  ni  1  +1* 

i 

”  1  »2| ♦ «  ♦  |fl| 

(12) 

Sj<  0. 

j 

”  1  )2  >  •  *  *  )IT) 

( 13)and 

Vj>  0. 

j 

“  1  |2  |  •  •  •  yll). 

If  the  optimality  condition  is  not  satisfied,  then  there  exists  one  or  more 

basic  rows  where  condition  (11),  (12)or  (13)  is  violated.  Define  t_  to  be  the 

Bk 
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dual  variable  most  violating  a  bound  restriction.  If  k  <  r,  the  k-th  row  of  XD 

—  D 

will  be  chosen  to  leave  the  basis.  On  the  other  hand,  if  k  >  r,  the  k-th  row  of 

I  will  be  selected  to  leave  the  basis.  Define  p  =  sign(iR  ).  The  value  of  p 

“k 

indicates  if  tr  is  to  be  increased  or  decreased, p  =  -1  implies  that  td 
k  Bk 

is  to  be  increased  and  p  =  +1  implies  that  1S  to  be  decreased. 

The  simplex  algorithm  of  linear  programming  maintains  at  zero  the 

current  deviations  of  all  basic  constraints  except  the  k-th.  In  other  words, 

the  6^  and  67  of  the  constraints  X.8  +  fit  -  67  =y..,  i  e IB,  i^k,  remain  zero 

and  Bj,  j  >  r,  j^k  remain  fixed  at  their  upper  or  lower  bound.  The  deviation  of 

the  k-th  basic  constraint  is  increased  to  a  value,  0  ,  and  another  constraint 

enters  the  basis  with  a  deviation  of  zero.  The  algorithm  determines  the  value, 

0,  to  increase  the  deviation  of  the  k-th  basic  constraint  while  (a)  decreasing 

the  objective  value  (ignoring  degeneracy),  (b)  maintaining  primal  feasibility 

and  (c)  obtaining  dual  feasibility  in  the  k-th  basic  variable  of  the  dual  problem 


If  k  >  r,  the  algorithm  guarantees  that  the  bound  restriction  on  Bk 
is  not  violated.  The  maximum  change  of  3k  possible  while  still  maintaining 
the  feasibility  of  this  constraint  is  U.  -  L.  .  Thus,  an  upper  bound  on  the 


change  in  the  value  of  8k  is  given  by  0^. 


(14) 


for  k  >  r 
for  k  <  r  , 


The  algorithm  next  calculates  ©g.  the  maximum  change  possible  in  the 
deviation  of  the  k-th  basic  constraint  if  the  primal  feasibility  in  the  8-, 

J 

j=l,2,...,r  is  to  be  maintained.  Define 


5  * 


'  XF(k)  k  <  r 


-xf\(k)  for  k  >  r 


where  X”jk^  is  the  k-th  column  of  X”1,  and  XR^  is  the  k-th  column  of  XR. 


(15)  =  min 


(Bj  -  Lj)/(-pCj)  for  pCj  <  0,  j=l,2 . r; 

(Uj  -  6^ )/(  pCj)  for  pC.  >  0,  j=l,2 . r. 


To  calculate  the  maximum  change  in  the  deviation  in  the  k-th  basic 
constraint  while  continually  decreasing  the  absolute  sum  of  the  deviations, 
©3,  the  algorithm  utilizes  the  basis  entry  tests  of  Barrodale  and  Roberts  [4]. 
These  tests  determine  a  nonbasic  dual  variable  which  is  to  enter  the  basis. 
The  procedure  is  to  calculate  the  ratio  values: 


(16)  (di )/(p4>- )  for  p^  >  0,  i=l,2,...,n 


where 


*i 


(x.,  x.„. . . ,  x.  )£ 
v  il,  i2  ir' 


for  k  <  r,  i  e  NB 


(xii*xi2- . - .  x.r)C  +  x-k  for  k  >  r,  i  E  NB 


The  dual  variable  tt  /  j  is  chosen  as  a  candidate  to  enter  the  basis 

by  a  ranking  of  the  ratios  and  the  following  feasibility  check  on  tr 

°k 

P-1 

(i)  |tbJ  -  Z  2|<J>0(i ) |  >1  for  k  <  r 

P-1 


(ii)  I tb^|  -  Z  2 J 4>0 ( 1 ) I  >  0  fork> 


-10- 


(iii)  |tb  |  -  2|<j>0^i j |  <1  for  k  <  r 


0V)  'V  '  ill  2ko(i)'  i 


0  for  k  >  r 


where  4iu  <  4gi  < ...  <  iifcU<  Jsiei 

^0(1)  ^0(2)  ^o(p-l)  ^(p) 

The  value  of  0^  equals  .  This  process  is  implemented  in  the  computer 

code  version  of  the  algorithm  with  the  partial  sort  process  of  Armstrorg, 

Frome  and  Kung  [21. 

The  value  of  0  is  therefore 
(17)  0  =  mintOj,  0 2,  0^}. 

In  the  case  of  0  =  0j,  the  working  basis  does  not  change.  On  the 
other  hand,  if  0  f  Gj,  a  new  basis  is  formed  and  Xp1  must  be  updated.  In  any 
event,  the  nonbasic  dual  variables  corresponding  to  the  candidate  list  of  ratios 
with  ratio  values  less  than  0  will  remain  nonbasic  but  will  switch  from  their 
current  bound  to  their  opposite  bound  value.  The  other  changes  in  the  primal 
and  dual  variables  are  given  as  follows. 

If  0  «  0j,  Bk  switches  bound  value  and  Xg  is  not  changed.  Relating 
this  situation  to  the  dual  problem,  the  nonbasic  w-  enters  the  basis  and  the 

J 

basic  Vj  leaves  the  basis  if  switches  from  its  lower  to  upper  bound.  On 
the  other  hand,  if  8k  switches  from  its  upper  to  lower  bound  value,  the  non¬ 
basic  Vj  enters  the  basis  and  the  basic  Wj  leaves  the  basis. 

If  0  *  0O,  a  nonbasic  row  of  I  will  enter  the  basis,  and  X„  will 
Z  Bk 

leave  the  basis,  where  Xg  is  the  k-th  row  of  the  basis  Xg.  In  the  dual 

problem,  the  nonbasic  Wj  or  Vj  will  enter  the  basis  and  tg  will  leave  the  basis. 


If  0  =  0j,  a  nonbasic  row  of  X  will  become  basic,  the  k-th  row  of  Xg 

(associated  with  the  basic  dual  variable,  tr  )  will  leave  the  basis.  In  terms 

Bk 

of  the  dual  problem,  the  nonbasic  tts  will  become  basic. 

There  are  five  cases  in  the  updating  process  of  Xp1. 

Case  1:  If  k  £  r,  0  =  0g,  this  is  the  situation  when  a  row  of  Xfi  is  leaving 

the  basis  and  a  row  of  X  is  entering  the  basis.  The  update  of  X^is 
the  standard  simplex  pivot. 

Case  2:  If  k  £  r,  0  =  this  is  the  situation  when  a  row  of  Xg  is  leaving 
the  basis  and  a  row  of  I  is  entering  the  basis.  Since  Xp1  contains 
the  rows  of  X  in  the  basis,  the  dimension  of  Xp1  will  be  decreased 
by  I. 

Case  3:  If  k  >  r,  0  =  0^,  Xp1  does  not  change. 

Case  4:  If  k  >  r,  0  *  03,  this  is  the  situation  when  a  row  of  I  is  leaving  the 

basis,  and  a  row  of  X  is  entering  the  basis.  The  dimension  of  Xp1  will 
be  increased  by  1. 

Case  5:  If  k  >  r,  0  =  0£.  this  is  the  situation  when  a  row  of  I  is  leaving 

the  basis  and  a  row  of  I  is  entering  the  basis.  The  dimension  of  X”1 
does  not  change. 

The  algorithm  then  updates  the  deviations  by 

(18)  di  d.j  -  >  i*l,2». . .  ,n. 

The  algorithm  also  updates  the  indicators  used  for  re-ordering  purposes. 

The  iterative  process  continues  until  the  condition  -1  <  td  <  +1,  1*1, 2, ...,r 

Bi 

and  td  <  0  or  td  >  0,  i*r+l,r+2,. . . ,m  is  satisfied. 

B1  ~  Bi  ” 

3.  Steps  of  the  Algorithm 

In  this  section  a  step-by-step  statement  of  the  algorithm  is  outlined. 

Step  1.  The  initial  values  of  1TR  are  found  from  the  following: 
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(i)  If  L.  <_  3 •  <  U.,  the  j-th  element  of  B,  is  set  equal  to  L. 

J  J  J  J  J 

(ii)  If  Lj  <  Bj  <  00  ,  set  Bj  =  Lj. 

(iii)  If  -»  <_  <_  U-,  set  B.i  =  U.. 

J  J  J  J 

After  interchanges,  B  =  (Bp.  BR)T,  where  BR 
is  a  vector  of  values  equal  to  the  upper  or  lower  bound  values  of  the  restric 
ted  parameters. 

Step  2.  Formulate  the  initial  basis,  Xg. 

(i)  If  all  the  parameters  are  restricted,  Xg  is  an  m  by  m  identity 
matrix. 

(ii)  When  all  the  parameters  of  the  problem  do  not  have  bound  res¬ 
trictions,  the  algorithm  attempts  to  form  the  basis  matrix  Xg 
by  choosing  a  full  rank  XR  matrix  from  the  coefficients  of  the 
unrestricted  parameters.  If  this  procedure  fails  to  create  an 
initial  Xg,  the  algorithm  advances  to  (iii). 

(iii)  A  full  rank  matrix  Xg  is  now  formed  by  including  in  the  initial 
basis  as  many  additional  rows  from  the  identity  of  (4)  as  is 
necessary.  The  Bj's  corresponding  to  these  rows  are  assigned 
upper  and  lower  bounds  of  plus  and  minus  Infinity. 

Only  the  values  of  X'1  anr'  the  corresponding  parameter 
indices  of  X"1  are  used  for  the  remaining  computations. 

Step  3.  Calculate  Bp  and  d^  based  on  (7)  and  (8).  Determine  the  values  of 
ir^,  i  e  NB,  based  on  the  sign  of  d^. 

Step  4.  Calculate  td  and  td  based  on  (9)  and  (10). 

°F  BR 

Step  5.  Check  for  the  optimality  conditions  given  by  (11),  (12)  and  (13). 


If  these  are  satisfied,  terminate.  Otherwise,  go  to  step  6. 
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Step  6.  Determine  the  value  of  p  from  the  sign  of  tb  where  Is  the  dual 

Bk  Bk 

variable  most  violating  a  bound  restriction. 

Step  7.  Calculate  0^,  dy  and  0  from  (14),  (15),  (16)  and  (17). 

Step  8.  If  0  =  0j,  switches  to  its  opposite  bound  value.  Go  to  step  12. 

Step  9.  If  0  =  ©2,  the  dimension  of  Xp*  is  decreased  by  1  if  k  r.  On  the 
other  hand,  the  dimension  of  Xp*  does  not  change  if  k  >  r.  Go  to 
step  11. 

Step  10.  If  0  =  03,  the  dimension  of  Xp*  remains  the  same  if  k  <  r.  If  k  >  r, 
the  dimension  of  Xp1  will  be  increased  by  1.  Go  to  step  11. 

Step  11.  Update  Xp1  and  the  other  basic  Indicators. 

Step  12.  Update  the  deviations  based  on  (18),  and  the  values  of  ,  i  e  NB, 
based  on  the  sign  of  the  updated  values  of  d^.  Go  to  step  4. 

4.  Computational  Results 

To  evaluate  the  efficiency  of  the  algorithm  given  here,  a  FORTRAN  ver¬ 
sion  of  the  algorithm  presented  here  called  RESL1  was  tested  against  the  algo¬ 
rithm  INTBND  developed  by  Armstrong  and  Hultz  [3].  The  INTBND  code  solves 
least  absolute  value  problems  with  arbitrary  linear  constraints  on  the  para¬ 
meters.  Both  codes  employ  the  revised  simplex  method  of  linear  programing. 

The  observations  for  the  study  have  been  drawn  from  various  uniform  distribu¬ 
tions  using  a  random  number  generator.  All  the  problems  were  solved  by  the 
CDC  6600  in  the  University  of  Texas  at  Austin.  The  results  presented  in 
Table  1  are  mean  times  and  iteration  counts  for  a  set  of  5  problems  with  the 
same  characteristics. 


4 


Number  of 

parameters 

Number  of 

observations 

Number  of 

unrestricted 

parameters 

5 

50 

0 

5 

50 

2 

10 

100 

0 

10 

100 

5 

15 

150 

0 

15 

150 

15 

15 

200 

0 

15 

200 

10 

20 

200 

0 

20 

200 

12 

20 

250 

0 

20 

250 

14 

25 

250 

0 

1  25 

250 

20 

1  25 

300 

0 

25 

300 

18 

30 

300 

0 

15 

500 

10 

15 

500 

0 

Time 

(In  CPU  milleseconds) 


RESL1  INTBND 


56 
115 
376 
968 
1004 
5629 
1671 
5463 
3016 
9334 
3897 
12566 
5663 
14445 
6086 
18751 
9142 
I  16872 
4643 


Number  of 
iterations 


RESL1 


5 

9 

11 

31 
14 
49 

23 
39 

32 
80 
34 
77 
27 
97 

24 
139 
41 
71 
26 


INTBND 


Our  computational  study  Indicates  that  the  algorithm  RESL1  Is 
consistently  faster  than  INT6N0  on  all  problem  sizes.  Also,  RESL1 
utilizes  a  reduced  basis  Inverse  and  requires  less  computer  storage 
than  INTBND. 

4.  Conclusion 

Since  the  time  of  Laplace  (161*  minimizing  the  sum  of  absolute 
deviations  has  been  considered  as  a  criterion  for  parameter  estimation. 
Recently,  LAV  estimators  have  been  widely  examined  as  a  robust  estimation 
technique  inland  with  this  Interest  has  come  a  demand  for  efficient 
algorithms  to  provide  LAV  estimates  for  a  variety  of  statistical  models. 
This  demand  has  been  satisfied  primarily  by  the  specialization  of  linear 
programming  to  take  advantage  of  the  distinctive  characteristics  of  the 
problem. 

This  paper  presents  an  approach  to  solve  least  absolute  value 
problems  with  bound  restrictions  on  the  parameters.  The  algorithm 
presented  here  exploits  the  structure  of  the  problem  to  maintain  a 
compact  representation  of  the  basis  inverse.  All  computations  required 
in  the  algorithm  can  be  performed  by  means  of  a  reduced  basis. 

The  algorithm  also  combines  several  standard  simplex  pivots  into  one. 
Computational  experience  with  a  FORTRAN  version  of  this  algorithm 
compared  to  a  FORTRAN  version  of  the  algorithm  developed  by  Armstrong 
and  Hultz  [3]  indicates  its  superiority  in  terms  of  computer  time 
and  storage. 
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